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ABSTRACT 

This paper reports on the application of spatially variant 
IIR filter banks to subband image coding. The new Alter 
bank is based on computationally efficient recursive poly- 
phase decompositions that dynamically change in response 
to the input signal. In the absence of quantization, recon- 
struction can be made exact. However, by proper choice of 
an adaptation scheme, we show that subband image coding 
based on time varying filter banks can yield improvement 
over the use of conventional filter banks. 
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(a) Analysis 


1. INTRODUCTION 

Recursive analysis and synthesis filter banks for subband 
coding have been considered previously and were shown to 
be particularly attractive because they preserve exact re- 
construction and can achieve tremendous computational ef- 
ficiency relative to comparable FIR systems [6], [8]. These 
filter banks are typically two-band systems that serve as 
building blocks for uniform and non-uniform band tree- 
structured systems. 

Much attention has been given in minimizing the per- 
ceptually significant coding distortions in image coding sys- 
tems. At low rates, aliasing and ringing distortions tend 
to be pronounced and have sperned some efforts to reduce 
these effects; but the success has been limited [9], [6]. The 
difficulty is that the step response ripples of the filters, 
which are the source of the ringing distortion, are needed 
to achieve good filter magnitude response characteristics. 
Good spectral magnitude characteristics are important for 
reducing the effects of aliasing in the presence of coding. 
Aliasing distortion appears as blurring in the image and is 
subjectively noticeable. If filters with good magnitude char- 
acteristics are used to reduce the aliasing, then ringing dis- 
tortion results which is also very noticeable and objection- 
able. Since both good step response and good magnitude 
response characteristics can not be achieved simultaneously 
for conventional filter banks, this poses a dilemma. 

A solution to this problem using IIR time-varying fil- 
ter banks was proposed at the IEEE DSP Workshop [2] 
and a theoretical analysis of the filter bank was presented 
in [4]. In this paper, we expand upon this idea giving spe- 
cial attention to its application to image coding. In the 
next section, we briefly summarize the results derived in [4] 
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(b) Synthesis 


Figure 1: Two-Band Polyphase Implementation of the 
Analysis/Synthesis System (a) Analysis, (b) Synthesis 


which are the basis for this work. In the follow section we 
consider a control mechanism for performing the adapta- 
tion and compare the performance of the overall system to 
that of a conventional system. 


2, SPATIALLY- VARIANT FILTER BANKS 

The two-band polyphase system, as shown in Figure 1, is 
commonly used in conventional subband analysis/synthesis 
systems. The lowpass and highpass analysis filters, Ho(z), 
and Hi(z), have the form: 

H 0 (z) = Po(* 2 ) + *" 1 i > 1 (* 2 ) (1) 

Hy{z) = P 0 (z 3 )-z~ 1 P 1 (z 7 ) (2) 

where Po(z) and Pi(z) are the analysis polyphase filters and 
C?o(z) and Qi(z) are the synthesis polyphase filters. This 
system has the property that its structure guarantees exact 
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The polyphase filters, Po(z) and Pi(z), are assumed to be 
causal stable recursive filters with zeros strictly outside the 
unit circle and have allpass or near allpass characteristics. 
The synthesis polyphase filters, Qo(z) and Q\(z), by defi- 
nition will have their poles outside the unit circle and their 
zeros inside the circle. Consequently they are anti-causal 
and stable. 

The new spatially-varying system is identical except 
that the filters change in response to the input. In particu- 
lar, the coefficients of the polyphase filters Po(z) and P\(z) 
are changed selectively at some point in the filtering process 
to another set of polyphase filters. Thus to preserve exact 
reconstruction it is sufficient to guarantee that ri[n] = t,[n] 
(where < = 0, 1) at all times before, during, and after the 
switching of coefficients. The derivation presented in [4] 
considered starting with a set of polyphase filters (p£ [n], 
pf[n]) and switching them to another set of filters (po [ n ]> 
Pi f n ])- For convenience, assume that we switch the filters 
at n = 0 and that the polyphase filters have the form: 


P L (*) 


«o -f of*- 1 + • • • + aM B z~ M ° 

1 + Pt*- 1 + /Sfz- 2 + • • • + Pjt 0 z~ N ° ‘ 


and 

I R ~ 1 i i R ~ A/ i 

R, s _ a 0 + Qj z H f <»M a * 

P ^ 1 + + P^Z-* + • • • + 0^ Z~ N > ‘ 

The labels L and R signify that the signal or filter coefficient 
is associated with the left and right half of the time index 
respectively. 

The direct form difference equations that implement the 
polyphase filters are: 


Mo N 0 

^[w] = - rn] - y>Mn ~ (3) 

mtsO /=1 

in the range — oo < n < — 1 and 

Ml N, 

«*[«] = ~ H ~ ” f\ ( 4 ) 

maO /si 

when 0 < n < oo. Note that t>z[n] and »*[”] are the left- 
sided and right-sided components of a polyphase filter out- 
put v[n], i.e. ti[n] = + »«[«]. Equation (4) requires the 

initial conditions Ni], vr[—Ni — 1], ..., vr[— 1] in or- 

der to evaluate »r[ 0]. These initial conditions are obtained 
from the past samples of the output, i.e. »*[n] = in 
the range —N\ < n < —1. 

The reconstruction equations (which are derived in [4]) 
are performed by anti-causal filtering and are defined by 
the difference equations 
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for — oo < n < —1. The assumption that the switching 
occurs at n s= 0 was done purely for convenience. But 
clearly these equations hold regardless of when the filters 
are switched. However, there is a constraint on how close 
together we can switch our filter. Switching points should 
occur at least No samples apart. In the next section, we 
consider how to determine when to switch a filter and what 
characteristics the filters should have in order to improve 
subjective and objective performance. 

3. ADAPTATION CONTROL SYSTEM 

The flexibility to switch among a set of different filters is 
potentially very powerful. But the key to make this work 
well is determining an effective control system for adapting 
the filters relative to the signal. Obviously there are many 
possibilities. The one investigated in this work is based on 
the observation that filters with good step response charac- 
teristics tend to perform better in local regions with sharp 
edges or transitions. Filters with good magnitude response 
characteristics seem to be better suited for the other re- 
gions. Thus two sets of filters are used in this system: filter 
set A, which has good magnitude response characteristics; 
and filter Bet B, which has good step response character- 
istics. Figure 3 shows the spectral magnitude response for 
the lowpass filters in sets A and B. Notice that lowpass filter 
A has good attenuation and transition characteristics while 
lowpass filter B does not. Figure 2 shows the step response 
for these filters. Here lowpass filter B has an almost ripple 
free characteristic while lowpass filter A does not. 

The remaining question is how to switch between these 
filters. Several points within the structure (see Figure 1) 
can be used to estimate an optimal switch point. For ex- 
ample, x[n], ro[n], to[n], or yo[n] represent estimation points 
in the structure that could be used to estimate sharp signal 
transition regions. The estimation procedure used here con- 
sists of computing the first backward difference of the sig- 
nal taken at one of the estimation points mentioned above. 
When the magnitude of the first backward difference ex- 
ceeds a pre-set threshold, we consider this to be a sharp 
transition and switch to filter set B. When that transition 
period is over, we switch back to filter set A. It is impor- 
tant to the performance of the system to switch the filters 
prior to and not during the transition. Therefore once a 
transition point is detected by the first backward difference 
estimator, we move back a few samples to the onset of the 
transition. Similarly when the estimator falls below the a 
lower threshold, the filter is switched back to filter set A. 

In the case where x(n], ro[n], or to[n] are used as es- 
timation points, side information must be transmitted to 
indicate the location of the switch point. For natural im- 
ages, the amount of side information is generally negligible. 
For example, for the test image Lena, only about 0.0281 
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Figure 3: Magnitude response characteristics for the low- 
pass filters A and B. 


bits/pixel was consumed by this side information. If, on 
the other hand, jio[n] is used as an estimation point, sending 
side information can be avoided. More precisely, the estima- 
tion should be performed on y[n] after it has been coded. 
This allows the synthesis section to derive the switching 
point from the exact same signal used by the analysis sec- 
tion to derive the switching point. This form of the im- 
plementation is a feedback adaptation approach. Interest- 
ingly, there is often enough information in the y 0 [«] signal 
to make an accurate estimation of major transitions. Even 
if the estimation is in error occasionally, the results are not 
catastrophic since the system performance is lower bounded 
by that of conventional subband coding (which is not bad). 

4. SIMULATION RESULTS 

To evaluate the new analysis/synthesis Bystem, we consid- 
ered a baseline pyramid two-level system with seven sub- 
bands and the Enumerative Lapladan Quantization (ELQ) 
encoder introduced by Darragh [10]. Further, we used the 
method of circular convolution to periodically extend our 
image boundaries [6]. The derivation of initial conditions 
for 2-D exact reconstruction with IIR filters is addressed 
in [6]. The 256 x 256 test image Lena was used in this ex- 
ample. A section of the original is shown in Figure 4. Figure 
5 shows Lena coded at 0.4527 bits/pixel with conventional 
IIR filter banks. The filters used are recursive (filter set 
A) with magnitude response and step response plots shown 
in Figures 3 and 2. The output corresponding to the new 
system is shown in Figure 6. It is coded at the same bit 


rate and uses r 0 [n] as an estimation point. Approximately 
0.0281 bits/pixel are devoted to the side information asso- 
ciated with the adaptation. In our feedforward system, we 
use an arithmetic coder as a lossless coder for the side infor- 
mation. The subjective quality is noticably better as shown 
by examining both coded outputs. The ringing distortion is 
quite noticeable around the boundary of the hat, as seen in 
5. On the other hand, the ringing distortion disappeared in 
the coded image using the new system, as seen in 6. Little 
magnitude distortion can be seen around the edges since 
the filter set of good step response and bad magnitude re- 
sponse is allowed to switch back very quickly after only a 
few samples. This improvement in quality is also reflected 
in the PSNR of the coded results. 

Several important aspects should be addressed in opti- 
mizing the performance of the new coder. First, the intelli- 
gent selection of threshold levels in determining the edges or 
boundaries within an image is critical. A good edge or level 
detector almost surely guarantees the success of the adapta- 
tion control system. Secondly, the issue of signal extension 
should be study carefully in light of the new spatially vari- 
ant system because the derivation of initial conditions no 
longer depends on only one distinct filter set, but man y ■) 
Finally, a feedback scheme can be considered where side in- 
formation for edge locations within an image will no longer 
be needed apriori for transmission over the channel. As 
with most image coding strategies, much of the improve- 
ment in quality comes as a result of fine tuning the coder. 
This has not be done yet at this point but should be done 
in time for presentation at the conference. 










Figure 4: Original test image Lena 
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Figure 5: Lena coded at 0.4527 bits/pixel using the conven- 
tional IIR filter banks with filter A as the basis filters. The 
ELQ coder is used to code the subband images. (PSNR = 
28.91 dB) 


Figure 6: Lena coded at 0.4527 bits/pixel using the new 
spatially-varying IIR filter banks. Filters A and B are em- 
ploying in the switching. The ELQ coder is used to code 
the subband images. (PSNR = 29.21 dB) 
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